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Abstract 



The tendency of semideflnite programs to compose perfectly under product has been ex- 
ploited many times in complexity theory: for example, by Lovasz to determine the Shannon 
capacity of the pentagon; to show a direct sum theorem for non-deterministic communication 
complexity and direct product theorems for discrepancy; and in interactive proof systems to 
show parallel repetition theorems for restricted classes of games. 

Despite all these examples of product theorems — some going back nearly thirty years — it 
was only recently that Mittal and Szegedy began to develop a general theory to explain when 
and why semideflnite programs behave perfectly under product. This theory captured many 
examples in the literature, but there were also some notable exceptions which it could not 
explain — namely, an early parallel repetition result of Feige and Lovasz, and a direct product 
theorem for the discrepancy method of communication complexity by Lee, Shraibman, and 
Spalek. 

We extend the theory of Mittal and Szegedy to explain these cases as well. Indeed, to the 
best of our knowledge, our theory captures all examples of semideflnite product theorems in 
the literature. 

1 Introduction 

A prevalent theme in complexity theory is what we might roughly call product theorems. These 
results look at how the resources to accomplish several independent tasks scale with the resources 
needed to accomplish the tasks individually. Let us look at a few examples of such questions: 

Shannon Capacity If a graph G has an independent set of size a, how large an independent 
set can the product graph G x G have? How does a compare with amortized independent set 
size limfc^oo This last quantity, known as the Shannon capacity, gives the effective 

alphabet size of a graph where vertices are labeled by letters and edges represent letters which can 
be confused if adjacent. 
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Hardness Amplification Product theorems naturally arise in the context of hardness amplifica- 
tion. If it is hard to evaluate a function f(x), then an obvious approach to create a harder function 
is to evaluate two independent copies f'(x, y) = (f(x), f(y)) of /. There are different ways that 
/' can be harder than / — a direct sum theorem aims to show that evaluation of /' requires twice 
as many resources as needed to evaluate /; direct product theorems aim to show that the error 
probability to compute /' is larger than that of /, given the same amount of resources. 

Soundness Amplification Very related to hardness amplification is what we might call sound- 
ness amplification. This arises in the context of interactive proofs where one wants to reduce the 
error probability of a protocol, by running several checks in parallel. The celebrated parallel repeti- 
tion theorem shows that the soundness of multiple prover interactive proof systems can be boosted 
in this manner [Raz98|. 

These examples illustrate that many important problems in complexity theory deal with product 
theorems. One successful approach to these types of questions has been through semidefinite 
programming. In this approach, if one wants to know how some quantity a(G) behaves under 
product, one first looks at a semidefinite approximation a(G) of a(G). One then hopes to show 
that a{G) provides a good approximation to cr(G), and that a(G x G) = a(G)a(G). In this way 
one obtains that the original quantity must approximately product as well. 

Let us see how this approach has been used on some of the above questions. 

Shannon Capacity Perhaps the first application of this technique was to the Shannon capacity 
of a graph. Lovasz developed a semidefinite quantity, the Lovasz theta function $(G), showed 
that it was a bound on the independence number of a graph, and that $(G x G) = $(G) 2 . In this 
way he determined the Shannon capacity of the pentagon, resolving a long standing open problem 

Hardness Amplification Karchmer, Kushilevitz, and Nisan [KKN95] notice that another pro- 
gram introduced by Lovasz HLov75H , the fractional cover number, can be used to characterize 
non-deterministic communication complexity, up to small factors. As this program also perfectly 
products, they obtain a direct sum theorem for non-deterministic communication complexity. 

As another example, Linial and Shraibman [LS06J show that a semidefinite programming quan- 
tity 7^° characterizes the disc repancy method of communication complexity, up to constant factors. 
Lee, Shraibman and Spalek [LSS08| then use this result, together with the fact that 7^° perfectly 
products, to show a direct product theorem for discrepancy, resolving an open problem of Shaltiel 
1555551 . 

Soundness Amplification Although the parallel repetition theorem was eventually proven by 
other means [Raz98, Hol07], one of the first positive results did use semidefinite programming. 
Feige and Lovasz HFL921I show that the acceptance probability u(G) of a two-prover interactive 
proof on input x can be represented as an integer program. They then study a semidefinite relax- 
ation of this program, and use this to show that if u(G) < 1 then sup k _ Jtoo uj(G k ) 1 ' k < 1, for a 
certain class of games G. More recently, Cleve et al. HCSUU07H look at two-prover games where 
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the provers share entanglement, and show that the value of a special kind of such a game known 
as an XOR game can be exactly represented by a semidefinite program. As this program perfectly 
products, they obtain a perfect parallel repetition theorem for this game. 

We hope this selection of examples shows the usefulness of the semidefinite programming ap- 
proach to product theorems. Until recently, however, this approach remained an ad hoc collection 
of examples without a theory to explain when and why semidefinite programs perfectly product. 
Mittal and Szegedy I1MS07H began to address this lacuna by giving a general sufficient condition 
for a semidefinite program to obey a product rule. This condition captures many examples in the 
literature, notably the Lovasz theta function HLov79ll , and the parallel repetition for XOR games 
with entangled provers HCSUU07L 

Other examples cited above, however, do not fit into the Mittal and Szeged y framew ork: 
namely, the product theorem of Feige and Lovasz HFL921I and that for discrepancy llLSS08 1. We 
extend the condition of Mittal and Szegedy to capture these cases as well. Indeed, in our (admit- 
tedly imperfect) search of the literature, we have not found a semidefinite product theorem which 
does not fit into our framework. 



2 Preliminaries 

We begin with some notational conventions and basic definitions which will be useful. In general, 
lower case letters like v will denote column vectors, and upper case letters like A will denote 
matrices. Vectors and matrices will be over the real numbers. The notation v T or A T will denote 
the transpose of a vector or matrix. We will say A y if A is positive semidefinite, i.e. if A is 
symmetric and v T Av > for all vectors v. 

We will use several kinds of matrix products. We write AB for the normal matrix product. For 
two matrices A, B of the same dimensions, A o B denotes the matrix formed by their entrywise 
product. That is, (AoB)[x, y] = A[x, y]B[x, y}. We will use A»B for the entrywise sum of AoB. 
Equivalently, A • B = Tr (AB T ). We will use the notation v > w to indicate that the vector v is 
entrywise greater than or equal to the vector w. 

In applications we often face the situation where we would like to use the framework of 
semidefinite programming, which requires symmetric matrices, but the problem at hand is rep- 
resented by matrices which are not symmetric, or possibly not even square. Fortunately, this can 
often be handled by a simple trick. This trick is so useful that we will give it its own notation. For 
an arbitrary real matrix A, we define 

" A\ 

A T 



A 



We will refer to this as the bipartite version of A, as such a matrix corresponds to the adjacency 
matrix of a (weighted) bipartite graph. In many respects A behaves similarly to A, but has the 
advantages of being symmetric and square. 

More generally, we will refer to a matrix M which can be written as 



M 



A 
B 
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as block anti-diagonal and a matrix M which can be written 



M 



D x 
D 2 



as block diagonal. 

One subtlety that arises in working with the bipartite version A instead of A itself is in defining 
the product of instances. Mathematically, it is most convenient to work with the normal tensor 
product 




A T ® 




A® A 











A® A 



T 



A 



A T ® A 1 








A® A 






Whereas what naturally arises in the product of problems is instead the "bipartite tensor" product 
of A: 

A® A 
A T ®A T 



A® A 



Kempe, Regev, and Toner [KRT07| observe, however, that a product theorem for the tensor 
product implies a product theorem for the bipartite tensor product. This essentially follows because 
A ® A is a submatrix of A ® A, and so positive semidefiniteness of the latter implies positive 
semidefiniteness of the former. See [KRT07] for full details. 



3 Product rule with non-negativity constraints 

In this section we prove our main theorem extending the product theorem of Mittal and Szegedy 
[MS07J to handle non-negativity constraints. As our work builds on the framework developed by 
Mittal and Szegedy, let us first explain their results. 

Mittal and Szegedy consider a general affine semidefinite program n = (J, A, b). Here A = 
( A\ , . . . , A m ) is a vector of matrices, and we extend the notation • such that A • X = (A\ • X, A 2 • 
X, . . . , A m • X). The value of tt is given as 

aM = max J • X such that 

x 

AmX = b 

x y o. 

We take this as the primal formulation of it. Part of what makes semidefinite programming so use- 
ful for proving product theorems is that we can also consider the dual formulation of n. Dualizing 
in the straightforward way gives: 

a*(n) = mmy T b 
y 

y T A - J h 
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A necessary pre-condition for the semidefinite programming approach to proving product theorems 
is that so-called strong duality holds. That is, that a(ir) = a*(ir), the optimal primal and dual 
values agree. We will assume this throughout our discussion. For more information about strong 
duality and sufficient conditions for it to hold, see HBV061I . 

We define the product of programs as follows: for ni = ( J 1; A 1; bi) and n 2 = (J 2 , A 2 , b 2 ) we 
define ixi x n 2 = (J\ <8> J2, -^1 ® A 2 , 61 <8> b 2 ). If Ai is a tuple of mi matrices and A 2 is a tuple 
of m 2 matrices, then the tensor product Ai <8> A 2 is a tuple of mim 2 matrices consisting of all the 
tensor products Ai[z] (g> A 2 [j]. 

It is straightforward to see that a(ir\ x ix 2 ) > a (711) a (7^). Namely, if X\ realizes a (711) and X 2 
realizes a(n 2 ), then X\ (g> X 2 will be a feasible solution to tti x 7r 2 with value a (711) a (7^). This is 
because X X ®X 2 is positive semidefinite, (Ai<g> A 2 )»(Xi®X 2 ) = (A 1 «X 1 )®(A 2 «X 2 ) = b\®b 2 , 
and (Jx <g> J 2 ) • (Xi <g> X 2 ) = (J x • X x ) ® (J 2 • X 2 ) = a(7Ti)a(7r 2 ). 

Mittal and Szegedy show the following theorem giving sufficient conditions for the reverse 
inequality a(ni x n 2 ) < a(7ri)a(7T 2 ). 

Theorem 1 (Mittal and Szegedy [MS07|) Let tti = (Ji, Ai, &i), 7r 2 = ( J 2 , A 2 , 6 2 ) affine 
semidefinite programs for which strong duality holds. Then a(7Ti x 7r 2 ) < a(7Ti)a(7r 2 ) if either of 
the following two conditions hold: 

1. J 1; J 2 b 0. 

2. (Bipartiteness) There is a partition of rows and columns into two sets such that with respect 
to this partition, Ji is block anti-diagonal, and all matrices in Aj are block diagonal, for 

ie{l : 2}. 

We extend item (2) of this theorem to also handle non-negativity constraints. This is a class of 
constraints which seems to arise often in practice, and allows us to capture cases in the literature 
that the original work of Mittal and Szegedy does not. More precisely, we consider programs of 
the following form: 

ot(ir) = max J • X such that 

x 

AmX = b 
B»X>0 

xyo 

Here both A and B are vectors of matrices, and denotes the all vector. 

We should point out a subtlety here. A program of this form can be equivalently written as an 
affine program by suitably extending X and modifying A accordingly to enforce the B • X > 
constraints through the X y condition. The catch is that two equivalent programs do not nec- 
essarily lead to equivalent product instances. We explicitly separate out the non-negativity con- 
straints here so that we can define the product as follows: for two programs, n\ = (J 1( Ai, b\, Bi) 
and 7r 2 = ( J 2 , A 2 , b 2 , B 2 ) we say 

7Ti x 7r 2 = ( Ji <g> J 2 , Ai <g> A 2 , 61 <g> b 2 , Bi <g> B 2 ). 
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Notice that the equality constraints and non-negativity constraints do not interact in the product, 
which is usually the intended meaning of the product of instances. 

It is again straightforward to see that a(ni x ir 2 ) > a(7Ti)a(7r 2 ), thus we focus on the reverse 
inequality. We extend Condition (2) of Theorem 1 to the case of programs with non-negativity 
constraints. As we will see in [Section 4, this theorem captures the product theorems of Feige- 
Lovasz IIFL921 and discrepancy [LSS081 

Theorem 2 Let iri = (Ji, Ai, bi, Bi) and n 2 = ( J 2 , A 2 , b 2 , B 2 ) be two semidefinite programs for 
which strong duality holds. Suppose the following two conditions hold: 

1. (Bipartiteness) There is a partition of rows and columns into two sets such that, with respect 
to this partition, Ji and all the matrices of B j are block anti-diagonal, and all the matrices 
of Ai are block diagonal, for i e {1, 2}. 

2. There are non-negative vectors U\, u 2 such that J\ = Bi and J 2 = u 2 B 2 . 
Then a(ni x 7r 2 ) < a(7Ti)a(n 2 ). 

Proof: To prove the theorem it will be useful to consider the dual formulations of i\\ and 7r 2 . 
Dualizing in the standard fashion, we find 

a(7Ti) =min y^bi such that 
yi 

y^Ai - OfBi + Jx) y 

zi > 

and similarly for 7r 2 . Fix yi, z\ to be vectors which realizes this optimum for %i and similarly y 2 , z 2 
for 7r 2 . The key observation of the proof is that if we can also show that 

+ (zf Bi + Ji) y and y 2 T A 2 + (z^B 2 + J 2 ) y (1) 



then we will be done. Let us for the moment assume Equation (1) and see why this is the case. 
If Equation (1)| holds, then we also have 

(y[Ai - (gBi + Ji)) ® (y 2 T A 2 + (z 2 T B 2 + J 2 )) b 
(j/fAj + (zfBi + JO) <g> (y 2 r A 2 - (z 2 T B 2 + J 2 )) b 

Averaging these equations, we find 

(yt ® y 2 ) T (Ai ® A 2 ) - ((zf Bi + JO ® (4B 2 + J 2 )) b 0. 

Let us work on the second term. We have 

(zfBx + JO ® (4 B 2 + J2) = (zi ® -2 2 ) T (Bi ® B 2 ) + Bi ® J 2 + Ji ® zj B 2 + J x <g> J 2 

= {zi ® z 2 ) T (Bi (8) B 2 ) + (zi (8) m 2 ) t Bi <g> B 2 
+ (ui <g> z 2 ) T Bi <8> B 2 + Jx ® J 2 . 



6 



also 



Thus if we let v = Z\ <8> z 2 + z\ ® u 2 + U\ <g> z 2 we see that v > as all of Zi,z 2 , U\, u 2 are, and 
(yi ® Z/ 2 ) T ® (Ai ® A 2 ) - (w T (Bi ® B 2 ) + Ji <8> J 2 ) b 0. 



Hence (yi y 2 ,v) form a feasible solution to the dual formulation of tti x 7r 2 with value (yi (g> 

® h) = a(7Ti)a(7r 2 ). 

It now remains to show that |Equation (1) follows from the condition of the theorem. Given 
yA — (^ T B + J) y and the bipartiteness condition of the theorem, we will show that yA + 
(z T B + J) y 0. This argument can then be applied to both iti and n 2 . 

We have that y T A is block diagonal and z T ~B + J is block anti-diagonal with respect to the 
same partition. Hence for any vector x T = [x± x 2 ] , we have 



[ Xl x 2 ] (y T A - (z T B + J)) 



x 2 



[xi -x 2 ] (y T A + (z T B + J)) 



Thus the positive semidefiniteness of yA + [z B + J) follows from that of yA — (z B + J). □ 



Xi 

-x 2 



One may find the condition that J lies in the positive span of B in the statement of |Theorem 2 
somewhat unnatural. If we remove this condition, however, a simple counterexample shows that 
the theorem no longer holds. Consider the program 



max 

x 







1 



X 



1 
such that I • X = 1 , 



"0 


1" 


• X > 0, 


"0 


0" 










1 






x > o,x y o. 

Here I stands for the 2-by-2 identity matrix. This program satisfies the bipartiteness condition of 



Theorem 2 but J does not lie in the positive span of the matrices of B. It is easy to see that the 
value of this program is zero. The program n x n, however, has positive value as J J does not 
have any negative entries but is the matrix with ones on the main anti-diagonal. 



4 Applications 

Two notable examples of semidefinite programming based product theorems in the literature are 



not captured by Theorem 1 Namely, a recent direct product theorem for the discrepancy method of 
communication complexity, and an early semidefinite programming based parallel repetition result 
of Feige and Lovasz. As we now describe in detail, these product theorems can be explained by 
ITheorem~2l 

4.1 Discrepancy 

Communication complexity is an ideal model to study direct sum and direct product theorems as 
it is simple enough that one can often hope to attain tight results, yet powerful enough that such 
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theorems are non-trivial and have applications to reasonably powerful models of computation. See 
HKN97B for more details on communication complexity and its applications. 

Shaltiel [Sha03] began a systematic study of when we can expect direct product theorems 
to hold, and in particular looked at this question in the model of communication complexity for 
exactly these reasons. He showed a general counterexample where a direct product theorem does 
not hold, yet also proved a direct product for communication complexity lower bounds shown by 
a particular method — the discrepancy method under the uniform distribution. Shaltiel does not 
explicitly use semidefinite programming techniques, but proceeds by relating discrepancy under 
the uniform distribution to the spectral norm, which can be cast as a semidefinite program . 

This result was recently generalized and strengthened by Lee, Shraibman, and Spalek IILSS08ll 
who show an essentially optimal direct product theorem for discrepancy under arbitrary distribu- 
tions. This result follows the general plan for showing product theorems via semidefinite program- 
ming: they use a result of Linial and Shraibman HLS06I that a semidefinite programming quantity 
72° (M) characterizes the discrepancy of the communication matrix M up to a constant factor, and 
then show that 7 2 X1 (M) perfectly products. The semidefinite programming formulation of j%°(M) 
is not affine but involves non-negativity constraints, and so does not fall into the original framework 
of Mittal and Szegedy. 

Let us now look at the semidefinite program describing 7^° : 

7 £° (M) = max M • X such that 
Xml = \ 

X • Eij = for all i ^ j < m, i ^ j > m 

X • (M o E^) > for all i < m,j > m, and i > m,j < m 

xyo. 

Here Eij is the 0/1 matrix with exactly one entry equal to 1 in coordinate (i,j). In this case, A is 
formed from the matrices / and Ey for 2 7^ j < m and i ^ j > m. These matrices are all block 
diagonal with respect to the natural partition of M. Further, the objective matrix M and matrices 
of B are all block anti-diagonal with respect to this partition. Finally, we can express M = u T B 
by simply taking u to be the all 1 vector. 

4.2 Feige-Lovasz 

In a seminal paper, Babai, Fortnow, and Lund [BFL91] show that all of non-deterministic expo- 
nential time can be captured by interactive proof systems with two-provers and polynomially many 
rounds. The attempt to characterize the power of two-prover systems with just one round sparked 
interest in a parallel repetition theorem — the question of whether the soundness of a two-prover 
system can be amplified by running several checks in parallel. Feige and Lovasz [FL92] ended 
up showing that two-prover one-round systems capture NEXP by other means, and a proof of a 
parallel repetition theorem turned out to be the more difficult question [Raz98J. In the same paper, 
however, Feige and Lovasz also take up the study of parallel repetition theorems and show an early 
positive result in this direction. 
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In a two-prover one-round game, the Verifier is trying to check if some input x is in the language 
L. The Verifier chooses questions s E S,t E T with some probability P(s, t) and then sends 
question s to prover Alice, and question t to prover Bob. Alice sends back an answer u E U 
and Bob replies w E W, and then the Verifier answers according to some Boolean predicate 
V(s, t, u, w). We call this a game G(V, P), and write the acceptance probability of the Verifier as 
u(G). In much the same spirit as the result of Lovasz on the Shannon capacity of a graph, Feige 
and Lovasz show that if the value of a game uj(G) < 1 then also sup fc uj(G k ) l l k < 1, for a certain 
class of games known as unique games. 

The proof of this result proceeds in the usual way: Feige and Lovasz first show that co(G) 
can be represented as a quadratic program. They then relax this quadratic program in the natural 
way to obtain a semidefinite program with value cr(G) > co(G). Here the proof faces an extra 
complication as cr(G) does not perfectly product either. Thus another round of relaxation is done, 
throwing out some constraints to obtain a program with value d~(G) > cr(G) which does perfectly 



product. Part of our motivation for proving Theorem 2 was to uncover the "magic" of this second 



round of relaxation, and explain why Feige and Lovasz remove the constraints they do in order to 
obtain something which perfectly products. 

Although the parallel repetition theorem was eventually proven by different means [Raz98, 
Hol07], the semidefinite programming approach has recently seen renewed interest for showing 
tighter parallel repetition theorems for restricted classes of games and where the provers share 
entanglement HCSUU071 iKRTOTl 

4.2.1 The relaxed program 

As mentioned above, Feige and Lovasz first write co(G) as an integer program, and then relax this 
to a semidefinite program with value <j(G) > ui(G). We now describe this program. The objective 
matrix C is a \S\ x |{7|-by-|T| x \W\ matrix where the rows are labeled by pairs (s, u) of possible 
question and answer pairs with Alice and similarly the columns are labeled by (t, w) possible 
dialogue with Bob. The objective matrix for a game G = (V, P) is given by C[(s, u), (t, w)] = 
P(s, i)V(s, t, u, w). We also define an auxiliary matrices B st of dimensions the same as C, where 
B st [(s', u), (t 1 , w)] — 1 if s — s' and t — t' and is zero otherwise. 
With these notations in place, we can define the program: 

a(G) = max -C • X such that (2) 

x 2 

XmB st = 1 for alls,* E SUT (3) 

X > (4) 

x y o (5) 



We see that we cannot apply Theorem 2 here as we have global non-negativity constraints (not 
confined to the off-diagonal blocks) and global equality constraints (not confined to the diagonal 
blocks). Indeed, Feige and Lovasz remark that this program does not perfectly product. 

Feige and Lovasz then consider a further relaxation with value a(G) whose program does fit 
into our framework. They throw out all the constraints of Equation (3) which are off-diagonal, 
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and remove the non-negativity constraints for the on-diagonal blocks of X. More precisely, they 
consider the following program: 



cr(G) = max -C • X such that 

x 2 



\X[(s,u),{s',w)} \ < 1 for alls, / G S 

U,WdU 

\X[(t,u),{t',w))\ < 1 for all t.t'eT 

u,w£W 

X • E^ u )^ ttW) > for all s G S, t G T, u G U, w G W 

x y o 



(6) 
(7) 

(8) 

(9) 
(10) 



Let us see that this program fits into the framework of Theorem 2 The vector of matrices B is 
composed of the matrices E( s , u ),(t,w) for s £ S,u £ U and t G T,w G W. Each of these matrices 
is block diagonal with respect to the natural partition of C. Moreover, as C is non-negative and 
bipartite, we can write C = -u T B for a non-negative u, namely where u is given by concatenation 
of the entries of C and C T written as a long vector. 

The on-diagonal constraints given by Equations (7), (8) are not immediately seen to be of the 



form needed for Theorem 2 for two reasons: first, they are inequalities rather than equalities, and 
second, they have of absolute value signs. Fortunately, both of these problems can be easily dealt 
with. 

It is not hard to check that |Theorem~2| also works for inequality constraints A • X < b. The 



only change needed is that in the dual formulation we have the additional constraint y > 0. This 
condition is preserved in the product solution constructed in the proof of|Theorem 2|as y <8> y > 0. 



The difficulty in allowing constraints of the form A»X < b is in fact that the opposite direction 
a{ni x 7r 2 ) > a(7Ti)a(7r 2 ) does not hold in general. Essentially, what can go wrong here is that 
ai,a 2 < b does not imply a\a 2 < b 2 . In our case, however, this does not occur as all the terms 
involved are positive and so one can show a(Gi x G 2 ) > a(Gi)a(G 2 ). 

To handle the absolute value signs we consider an equivalent formulation of &(G). We replace 
the condition that the sum of absolute values is at most one by constraints saying that the sum of 
every possible ± combination of values is at most one: 



ct'(G) = max -C • X such that 

x 2 



(-l) Xuw X[(s, u), (s', w)] < 1 for all s, s' G S and x G {0, 1} 
(-l) Xuw X[(t, u), (f, w)] < 1 for all t,t' G T and x G {0, 1} 



\u\ 2 
\w\ 2 



u,wGW 

X • £( SjU ),(t, w ) > for all s G S, t G T, u G U, w G W 
X y 



This program now satisfies the conditions of Theorem 2 It is clear that u(G) = cr'(G), and 
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also that this equivalence is preserved under product. Thus the product theorem for a(G) follows 
from lTheorem 21 as well. 



5 Conclusion 

We have now developed a theory which covers all examples of semidefinite programming product 
theorems we are aware of in the literature. Having such a theory which can be applied in black-box 
fashion should simplify the pursuit of product theorems via semidefinite programming methods, 
and we hope will find future applications. That being said, we still think there is more work to 
be done to arrive at a complete understanding of semidefinite product theorems. In particular, we 



do not know the extension of item (1) of Theorem 1 to the case of non-negative constraints, and it 



would nice to understand to what extent item (2) of [Theorem 2| can be relaxed. 

So far we have only considered tensor products of programs. One could also try for more 
general composition theorems: in this setting, if one has a lower bound on the complexity of / : 
{0, l} n — > {0, 1} and g : {0, l} k — > {0, 1}, one would like to obtain a lower bound on (fog)(x) = 
f(g(xi), . . . , g(x n )). What we have studied so far in looking at tensor products corresponds to the 
special cases where / is the PARITY or AND function, depending on if the objective matrix 
is a sign matrix or a 0/1 valued matrix. One example of such a general composition theorem 
is known for the adversary method, a semidefinite programming quantity which lowe r bound s 



quantum query complexity. There it holds that ADV(/ 051) > ADV(/)ADV(sO HAmb03llHLS07 l. 
It would be interesting to develop a theory to capture these cases as well. 
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